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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 29 November 2004 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-8 and 11-15 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) g] Claim(s) 1-8 and 11-15 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)Q None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mail Date . 6) □ Other . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 20050216 



Application/Control Number: 09/881 ,81 5 Page 2 

Art Unit: 2611 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible 
for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1 .1 7(e) has 
been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 
CFR 1.114. Applicant's submission filed on 11/29/04 has been entered. 

Claim Rejections - 35 USC § 102 



2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claims 1 and 14 are rejected under 35 U.S.C. 102(e) as being anticipated by Kitsukawa 
et al. (US 6,282,71 3 B1). 

Regarding claim 1, Kitsukawa discloses a method of delivering advertising to a user via 
composite images displayed to the user through a TV 4 (see figure 2), comprising the steps of: 
displaying a program 502 (see figure 5); and 

inserting, while the program 502 is being displayed, an advertisement (e.g., 521, 
522... or 529) into a selected portion of the displayed program 502, the advertisement being 
displayed in a manner appropriate to the content of the displayed program (e.g., elements 521- 
529 are displayed together with the program 502 as shown in figure 5) (see figure 5 and col. 8, 
lines 20-36), 
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wherein the program 502 is interactive program enabling users to interact with the 
program via three operating modes (see col. 7-8, lines 61-16), and wherein the advertisement is 
updated based on responses to the program content (e.g., based on the user selection for a 
item 522 corresponding to program content 512, the further advertising information is provided. 
The further advertising information may comprise cost information, electronic catalogs, 
manufacturer's information, electronic links over the Internet - see col. 8, lines 41-66), the 
responses to the program content being submitted by the user via interface device 2 (see figure 
3). 

Regarding claim 14, Kitsukawa discloses a system of delivering advertising to a user via 
composite images displayed to the user through a TV 4 (see figure 2), comprising the steps of: 
means displaying a program 502 (see figure 5); and 

means inserting, while the program 502 is being displayed, an advertisement (e.g., 521, 
522... or 529) into a selected portion of the displayed program 502, the advertisement being 
displayed in a manner appropriate to the content of the displayed program (e.g., elements 521- 
529 are displayed together with the program 502 as shown in figure 5) (see figure 5 and col. 8, 
lines 20-36), wherein the program 502 is interactive program enabling users to interact with the 
program via three operating modes (see col. 7-8, lines 61-16), and wherein the advertisement is 
updated based on responses to the program content (e.g., based on the user selection for a 
item 522 corresponding to program content 512, the further advertising information is provided. 
The further advertising information may comprise cost information, electronic catalogs, 
manufacturers information, electronic links over the Internet - see col. 8, lines 41-66), the 
responses to the program content being submitted by the user via interface device 2 (see figure 
3). 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 2 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kitsukawa et al. (US 6,282,713 B1) in view of Rosser (WO 98/28906). 

Regarding claims 2 and 15, Kitsukawa does not disclose inserting advertising 
comprising merging a simulated image into the program. However, Rosser discloses inserting a 
simulated image such as a still, animated or live video, i.e., AD1 or LOGO B, into a broadcast 
program (see page 10, lines 7-12; page 13, lines 20-27; pages 13-14, lines 36-11). Therefore, it 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
modify the system of Kisukawa by inserting a simulated image into the broadcast program as 
taught by Rosser in order to provide an attractive advertisement to viewer. 

6. Claims 7 and 8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kitsukawa et al. (US 6,282,71 3 B1 ) in view of Kohen (US 6,604,239 B1 ). 

Regarding claim 7, Kitsukawa does not explicitly disclose that the advertisement is 
updated in real time. However, Kohen discloses that advertisements, production issues, through 
which the user can browse to receive real time, or close to real time, updated information on 
television programs, advertisements (see col. 7-8, lines 66-5). Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
system of Kitsukawa by providing the updated advertisements in real time as taught by Kohen in 
order to provide the user the latest information. 
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Regarding claim 8 f Kitsukawa as modified by Kohen by discloses that the module 32 
provides the updated advertisements in real time (see col. 7-8, lines 66-5). 

7. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kitsukawa et al. 
(US 6,282,713 B1) in view of Stautner (US 6,172,677 B1). 

Regarding claim 11, Kitsukawa does not further disclose that the user is given the option 
of performing on-line or off-line transactions in response to the advertisements. However, 
Stautner teaches that Pizza Hut advertisement includes telephone number for the user makes 
an order anytime at anywhere. The user can select icon 40 to place an order on-line. By 
selecting icon 40, an automated sequence of events performed by the computer would then 
extract a proper telephone number from the data base, dial the particular number and place the 
user in a situation where they are in voice contact with the pizza restaurant or alternatively, 
provide for an automatic selection of the specifications of their desired pizza (see figure 2 and 
col. 5, lines 25-28; col. 6, lines 50-59). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the system of Kisukawa by 
providing user option of perform on line by selecting icon 40 or off-line, e.g., by dialing 
telephone number from user, as taught by Stautner in order to optionally provide user an 
automatic selection for ordering product/goods or service. 

8. Claims 12 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kitsukawa et al. (US 6,282,713 B1) in view of Gautier (US 6,618,858 B1). 

Regarding claim 12, Kitsukawa discloses providing electronic links over the Internet to 
the Web pages of product manufacturers and dealers (see col. 8, lines 53-57). Kitsukawa does 
not disclose a login process including the steps of determining an identity and location of the 
user; organizing the identity and location information into a suitable information packet; and 
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storing the packet in the user's computing device or in computing devices located in the 
premises of the provider. 

However, Gautier teaches that when a viewer logs onto services through an advanced 
set-top-box (ASTB), the viewer enters a TV name which is used to identify that viewer's account 
or identity locally on the ASTB. The viewer also enters a PIN and a service he/she wants to 
access. This information is then used on the local ASTB to retrieve a UID. The UID along with 
other information is transmitted over the network to the MSO. The MSO uses the UID to retrieve 
any information it needs to process the viewer's requests (see figure 3; col. 7, lines 21-36 and 
col. 7-8, lines 61-4). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the system of Kitsukawa by including login process to verify the 
viewer identification for accessing the service as taught by Gautier for system security 
purposes. 

Regarding claim 13, Kitsukawa discloses that the interface device 2 is computing device, 
and further comprising the steps of permitting the user to select whether to accept updating of 
the computing device (e.g., via first mode - see col. 7, lines 65-67 and col. 8, lines 46-47). 
9. Claims 3-6 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kitsukawa et 
al. (US 6,282,713 B1) in view of Rosser (WO 98/28906) and further in view of Wilf et al. (US 
6,208,386 B1). 

Regarding claim 3, the combination of Kitsukawa and Rosser does not teach using "blue 
screen" technology for the step of merging. However, Wilf et al. teach using chroma-key or blue 
screen technology for electronically replacing a real billboard in a video image display by the 
replacement billboard. By use of the chroma-key technology there is no requirement to transmit 
any occlusion data since this can be readily inserted at a receiver and the occlusion inserted in 
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the normal manner (see col. 3, lines 39-42; col. 4, lines 21-24 and 30-32; col. 5, lines 6-20 and 
46-47; col. 14, lines 29-33). Therefore, it would have been obvious to one having ordinary skill in 
the art at the time the invention was made to modify the combined system of Kitsukawa and 
Rosser by using the chroma-key or blue screen technology for replacing a portion of the video 
image, i.e., real billboard in the video image, by a replacement portion, i.e., replacement 
billboard, at the receiver as taught by Wilf for the advantage of inserting an image into a video 
image at the receiver with less cost. 

Regarding claim 4, the combination teachings of Kitsukawa, Rosser and Wilf teach that 
wherein application of the blue screen technology involves adding blue coloring to portions of a 
real-life environment (Wilf et al. disclose that the billboard to be replaced is blank and is of 
colour suitable for chroma-key replacement such as blue- see Wilf: col. 5, lines 53-55). 

Regarding claim 5, the combination teachings of Kitsukawa, Rosser and Wilf teach that 
wherein real-life environment is a sports venue (for example, Rosser shows that a live 
television broadcast of an event such as a sport event being played on a court 10 - see figure 
1), and said blue-painted portions of the real-life environment are areas on which 
advertisements would normally be displayed, including areas of billboards (for example, Wilf 
discloses that in an arrangement within a stadium or other sport venue real billboards with 
normal advertising material will be situated on one side of the stadium to be viewed by a first 
plurality of cameras and chroma-key billboards will be situated on another or the opposite side 
to be viewed by a second plurality of cameras - see col. 5, lines 10-15). 

Regarding claim 6, the combination teachings of Kitsukawa, Rosser and Wilf do not 
teach that a real life environment is a musical event. However, the combination teaching of 
Rosser and Wilf et al. is used in a real life environment such as a sport event wherein 
advertisements are displayed on background of the event by using blue screen technology 
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(see Rosser: figure 1 and Wilf: col. 3 t lines 39-42; col. 4, lines 21-24 and 30-32; col. 5, lines 6- 
20 and 46-47; col. 14, lines 29-33). In view of this, Official Notice is taken that it is well known 
in the art to use the system as taught by Kitsukawa, Rosser and Wilf for a musical event to 
present advertisements on the background of the stage. Therefore, it would have been obvious 
to one having ordinary skill in the art at the time the invention was made to present 
advertisements on a background of a stage in a musical event for the desirable benefit of 
providing the advertisements to a wider range of audiences. 



Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Ngoc K. Vu whose telephone number is 703-306-5976. The examiner can 
normally be reached on Monday-Thursday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher Grant can be reached on 703-305-4755. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Conclusion 




Ngoc K. Vu 
Examiner 
Art Unit 2611 



February 16, 2005 



